1362 



Assessing the Cost of Web-Based Training Programs 
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Investments in web-based training (WBT) have increased presumably to attain cost savings and 
performance improvement. However, it has been difficult to assess the cost of WBT. In order to conduct an 
accurate cost analysis of WBT, three primary issues remain as follows: 1) identifying the missing cost 
components of WBT, 2) assessing the costs of these missing components, and 3) establishing a model to 
identify the costs of future WBT. 
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Training expenditures in the United States were estimated in 1998 to be $60 billion {Training , 1998). Of that 
amount, it has been further estimated that investments in web-based training (WBT) has been $3.5 billion in 
domestie and $5 billion in overseas, and will expand to $50 billion by 2010 (Levis, 2002). Sinee the investment of 
eorporate training programs has been rapidly inereasing, organizations have been growing demand to improve eost 
reduetion and eost effeetiveness for the worth of training. 

Investments in WBT have inereased based upon the belief that it has the potential to reduee training time and 
eost, inerease the volume of trainees, and in the end be as effeetive in improving job performanee of employees. 
The European Commission (2003) asserts that given a rapidly ehanging global business environment, WBT 
eontributes to organizational efforts to improve job performanee. In addition, Bemadez (2003) states that online 
learning provides an organization with eost effieieney of training in that it ean do anytime and anywhere, saving 
direet and indireet expenditures. 

At this point, it is neeessary to know how mueh aetual eost of WBT is spending and whether its eost is justifiable 
(Bartley & Golek, 2004) and all its benefits are equitable to all stakeholders and an organization (Willis, 2003). The 
ealeulation of eost analysis of training beeomes more a eritieal issue for finaneial benefit of training than ever before 
(Martin & Lomperis, 2002; Bartley & Golek, 2004). 

The reason is that, based on the eost analysis of WBT, deeision makers are able to prediet finaneial benefits of 
their online programs and make right deeision to determine the training eosts and eost effeetiveness for their 
organizations. For example, after analyzing the eosts of WBT, deeision makers ean set up its budgets and determine 
whether or not the program is ereating, reshaping or eaneeling in their organizations (Rumble, 2001). 

Flowever, researehers and praetitioners have been stmggling to determine how to preeisely measure the eost 
analysis of WBT that ean lead less eost reduetion and more eost effeetiveness in the workplaee. Today it ean be 
more diffieult to estimate the expenditure of WBT, sinee the eontext and aetivities of WBT vary by the types of 
organizations and jobs, baekground of learners, availability of edueational media, and so on (Jung & Rha, 2000; 
Curtain, 2002). 

Mostly, the eost of training aetivities is not able to ealeulate aeeurately due to the laek of information of the 
budget or aeeount. For example, aetivities may exeeed the budget or aeeounting tiseal year, personal salary data are 
not available, or aeeommodation eosts are not elear (Rumble, 2001). In large organizations, it is espeeially hard to 
eateh all training expenses spent due to the absenee of enormous aetivity reeords and fiseal aeeounting systems 
(Curtain, 2002). In addition, an organization eould not provide aeeurate data due to its eonfidentiality (Curtain, 
2002 ). 

Meanwhile, researehers frequently faee limits in ealeulating aeeurate training eosts (Curtain, 2002). In some 
eases, some researehers inelude indireet eosts related to salary that other researehers do not inelude in ealeulating 
eost analysis of WBT. Aeeordingly, the total eosts among studies will be signifieantly different (Odden, Arehibald, 
Fermanieh, & Gallagher, 2002). In faet, most organizations also subjeetively evaluate eosts and benefits of WBT 
with different methodologies, sinee they only use available data in their own organizations. 

Aeeordingly, this makes it more diffieult to estimate aeeurate eosts of WBT in order to measure eost savings 
and eost effeetiveness in the workplaee (Bakia, 2000). Whereas organizations put a high value on ealeulating 
finaneial benefits of WBT in order to provide effeetive training and performanee with the least dollars, previous 
studies still have been eonfusing and diffieult to ealeulate the eost analysis of WBT in the workplaee. 
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The purpose of this paper is to deseribe what is meant by web-based training, to identify the faetors to eonsider 
when identifying the eosts of training, and diseuss the eosts of web-based training, ineluding a diseussion of the 
missing eomponents in most eost analysis of web-based training. 

The primary methodology for this study is a literature review on eost analysis of WBT in the workplaee. Over 
eighty artieles for this study are reviewed and analyzed through aeademie journals, praetitioner periodieals, and 
books published from 1994 to 2005. Authors have searehed for reeent literatures, sinee this study is related to 
teehnology that plays a key role in today’s rapidly ehanging and eompetitive business environment. Key words in 
the databases and journals are e-leaming, eost analysis of WBT, eost benefit analysis of WBT, finaneial benefits of 
WBT, and related terms. 

The proeess used in this study eonsists of the following two steps. The first step identified the faetors needed to 
eonsider in ealeulating the eosts of training programs. In the first step, the literature was reviewed to understand the 
phenomenon to formulate the study. The seeond step expanded the literature into WBT to analyze and speeify the 
eosts of WBT based upon the faetors identified in the first step. In the seeond step, frequently appeared authors are 
seleeted in the literature. 

Web-Based Training (WBT) 

Web-based Training (WBT) refers to leamer-eentered learning through the Internet using a variety of edueational 
media sueh as text, pietures, animations, audio, and video. Learners are able to seleet learning aetivities and a 
favorite media format by their own preferenee and learning styles. For example, a learner ean wateh a video instead 
of reading texts, simply elieking a video button on the Web Instruetion. 

In addition, a learner interaets with his/her instruetor and peers both synehronously and asynehronously. In a 
synehronous way, a learner and an instruetor log in and eommunieate at the same time through video eonfereneing, 
web easting, live-ehat room and so on. In an asynehronous way, a learner and an instruetor eommunieate at any time 
through diseussion boards, forum, email, and so on. 

Not surprisingly, WBT signifieantly impaets on eorporate training with its enormous potential benefits that 
maximize eurrent eeonomie situation - rapidly ehanging business environments and global labor market needs. The 
one of major benefits of WBT is that learners ean save training eost and time. Employees at Aetna US Health Care 
ean minimize its training time to one or three weeks from six weeks in the elassroom through online eourses (Noe, 
2004). Furthermore, WBT ean be of mueh benefit to inerease the volume of learners in geographieally dispersed 
loeations (Sheperd, 1999; Evan & Hasses, 2001; Noe, 2004). Learners ean aeeess their eourses through Internet 
aeross offiees, metropolitan areas, and eountries, wherever they are. 

In addition, they ean reeeive just in time training and support from their instruetors, experts, and peers through 
Internet (Wild, R. & Griggs, K., & Downing, T., 2002). Aeeording to Sheperd (1999), WBT is able to improve job 
performanee of learners to be eompetitive in the global market with following four faetors; “individualism”, 
“immediate eonstruetive feedbaek”, “aetive learner involvemenf’, and “an appeal to multiple senses”. For example, 
learners ean be more effeetively assoeiated with multi media - sueh as graphies, sounds, animation, and so on - and 
be more aetively involved in a variety of learning aetivities - sueh as praetiees, questions, diseussion, and so on - 
through the Web in order to improve their learning performanee (Noe, 2004). 

Another major benefit of WBT is that learners ean eonfrol their online eourses to their own learning paee, 
learning style, and learning aetivity (Noe, 2004; Bartely & Golek, 2004). For example, they ean eontrol their 
learning speeds, ehoose appropriate praetiees and questions, and interaet with their instruetor or peers on their 
demands (Noe, 2004). Additional major benefits of WBT inelude as follows; learners ean easily aeeess to all 
required resourees to perform training and instruetors or designers ean quiekly update eontents through the Web (e.g. 
using HTML), redueing extra paper works (Noe, 2004; Evan & Hasses, 2001). 

A benehmarking survey of WBT in 2001 reported that 43% of eompanies partieipated in the survey had already 
implemented or were implementing WBT and 33% of them would implement within next three years in the United 
States and Canada (Sofres, 2001). However, many reeent studies show that aetual usage of WBT has been 
dramatieally deelined. Aeeording to ASTD in 2001, only 14% of aetual users prefer to WBT and over 60% of them 
drop out their online eourses in the workplaee (Buren & Sullivan, 2001). 

In previous researeh (Kong & Zirkle, 2005), five primary reasons for high drop out rates of early WBT are 
found: 1) low quality of eontents, 2) laek of organization management, 3) teehnologieal limits, 4) laek of learner 
aeeeptanee, and 5) laek of instruetor aeeeptanee. Firstly, early WBT too mueh foeuses on eognitive domain only, 
while eognitive, affeetive, and psyehomotor aetivities are required in WBT (Stahl, 2001; Rosenberg, 2002). Online 
eourse learners just turn page to page without any learning aetivity that ean be interaetive with them (Woodill, 2004). 
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Low quality of contents also results from not only improper assessment that does not match learners’ needs but 
also absence of formative evaluation that does not provide learners with appropriate feedback (Buchanan, 1999; 
Yilmaz & Tuzum, 2001; Rosenberg, 2002). Irrelevant graphics (e.g. fancy banners, splash pages, etc.) also do not 
contribute to the instructional value of multimedia (Kedney & Puckett, 2003). 

In addition, early online courses use only one generic template to create a variety of courses (Nantel, 2001) and 
do not take into account customization and future maintenance to have the content updated for quality assurance 
(Woodill, 2004). Contents also incorrectly assume only one audience and complex contents are frequently 
oversimplified (Rosenberg, 2004). 

Secondly, many organizations do not make the right decision to purchase appropriate online courses from 
professional vendors, without considering how to best fit the program in their organizations. They usually buy the 
most courses offered in the market with the least dollars (Naish, 2004; Mullich, 2004; Rosenberg, 2002). Further, 
learners do not receive sufficient support from their management to conduct training. They have insufficient time to 
learn, many interruptions from their work, lack of technological knowledge, and a lack of support from their bosses 
(Naish, 2004). Additionally, trainees rarely realize the ultimate goals of both individuals and their organizations due 
to lack of learning orientation (Rossett & Schafer, 2003). 

Thirdly, most learners in early WBT are often isolated and lack social interaction due to technological limits 
(European Commission, 2003). The main barrier of technology is that technology has low bandwidth and lacks 
high-speed Web connections for interactivity between an instructor and learners; thus, it produces frustration and 
little credibility between them (Wulf and Schinzel, 1998; Dreyfus, 2001; Yilmaz and Tuzun, 2001). 

Fourthly, many learners get frustrated and depressed in new technology environment, since they do not know 
how to be effective self-learners (e.g. self-motivation and self-discipline, etc.) (Rossett & Schafer, 2003). 
Additionally, many learners have insufficient technical skills (Smith, 1999). Lastly, many online instructors have 
overwhelming workload to interact with every learner by one-on-one mails (Sellani & Harrington, 2002). Fear of 
technology has been also addressed as a significant problem of online instructors (Simonson et ah, 2003). 

Consequently, many companies realized that WBT was not a panacea for all types of training in the workplace. 
Hence, they make an effort to find optimal balance between WBT and traditional classroom training and make more 
modest investment to WBT with small initial costs (Mullich, 2004). For example, “Basic Blue”, IBM’s training 
program for new managers, was trained in a five day workshop in the past. However, IBM changed it to a 12-month 
training program combining online courses and a five day workshop, since the workshop was not effective to 
provide all the information in a short time. As a result, they found that mangers can save one third of their training 
costs and increase their learning performance five-fold (Mullich, 2004). 

Assessing the Cost of Training 

There are nine categories of the costs of training suggested Jacobs (2005). Work analysis cost is the expenditures 
occurred in the process of investigating the work for the program. Training development cost is mainly related to the 
expenditures for subject matter experts or instructional designers who make the program. Trainer cost is the 
expenditure needed to train the trainers. Consultant cost has to be met, if a company needs experts’ advice on 
training. Material costs are associated with resources used during training. Training evaluation cost is the 
expenditures needed to analyze the program. Trainer backfill cost is the cost for the trainer to incur new knowledge 
or skill to teach the program. Trainee’s time cost is an opportunity cost that trainees endure during training hours by 
not doing work. Performance follow-up cost is the expenditures needed to investigate how well the trainees enhance 
their performance after training. 

Concerning type of training costs, Lachance (1999) suggests five categories, including training attendance costs, 
instructor costs, instructional development personnel costs, additional instructional development costs, and facility, 
material, & equipment costs. Attendance costs are related to participant’s time spent in training, travel and per diem 
costs, and lost productivity or cost of replacing the individual during training. Instractor costs are associated with 
instructor’s time spent in training, travel and per diem costs, and lost productivity or cost replacing the individual 
during training. Instructional development personnel costs are the personnel expenditures for the design and 
development of the training materials. Additional instructional development costs are the resource. 

According to Bartolic-Zlomislic & Bates (2002), the costs of WBT can be divided into three factors as follows: 
capital and recurrent costs, production and delivery costs, and fixed and variable costs. Capital and recurrent costs 
include equipment and support for a program. Production and delivery costs include the costs that occurred in the 
process of the delivery and development of a program. Fixed and variable costs remain stable regardless of the 
number of trainees or any change in the number of trainees. 
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Willis (2003) suggests that the eosts of WBT mainly inelude aeademie support serviees, teehnology and 
produetion serviees, program administrations, marketing support, and overall program researeh and development. 
Aeademie support serviees inelude registration proeess, shipping materials, and other aetivities. Teehnology and 
produetion serviees are assoeiated with teehnieal development, editing, and duplieation of a program. Program 
administration ineludes reviewing and establishing new programs, eertifieate initiatives, and short eourses, as well as 
the review, evaluation, and updating of existing programs. Marketing support ineludes the establishment and 
maintenanee of a high-profile and high-quality web site. Overall program researeh and development inelude 
exploration of alternative hardware/software delivery formats and the exploration of new program eontent areas. 

Assessing the Cost of WBT 

To eonfirm sure that WBT is eost-effeetive, one must elarify the definitions of eosts at all stages of training sueh as 
analysis, design and development, promotion, administration, delivery, and evaluation (Shepherd, 2005). Shepherd 
(2005) also suggests that sueh indireet eosts as internal salaries and benefits of trainers and administrators, the use of 
internal faeilities, and the opportunity eost of trainee’s time should be estimated in the proeess of eost analysis of 
WBT. 

Costs of a program ean be divided into its establishment and reeurrent eosts (Curtain, 2002). In most eases, 
studies have indieated that development and establishment eosts of a program are signifieantly higher than its 
delivery eosts. Curtain (2002) provides a ease study of Department of Animal and Biologieal Seienee at Box Hill 
Institute, whieh involves establishment eost assessment. In the ease of this organization, the development eosts of an 
online eourse were spent 100% or more additional expense eompared with faee-to-faee delivered eourses. 

It is diffieult to assess aeeurately reeurrent eosts, sinee there are numbers of aspeets of reeurrent eosts on 
delivering a web-based eourse. All of them need additional time-eonsuming tasks (Curtain, 2002). Mistakes in 
taking the new work proeess ean bring about high eosts of the program. Curtain (2002, p 13 1) provides a ease study 
of ACENET to explain this phenomenon. 

This finding is eonfirmed in an Australian setting by an ineident reported by the ACENET eo-ordinator where 
an instmetor was eontraeted to run a eourse, Introduetion to the internet, available through the Vietorian 
TAFEVC (a ‘virtual eampus’). Forty students enrolled in the eourse of Introduetion to the Internet. However, 
due to the limited language and eomputer skills of the students, the unit had to be eustomized to meet their 
speeifie needs. This was done while paying $1000 for his work. However, it was not antieipated that throughout 
the eourse he would reeeive approximately 500 emails from students requiring help. As a result, the instruetor 
suggested a more appropriate fee for the eourse would be $4500. ACENET were unable to pay him this amount 
and so a halfway figure of $2500 was agreed upon. 

Traditionally, training evaluation involves both formative and summative evaluation (Noe, 2004, pl71-172). 

Formative evaluation refers to evaluation eondueted to improve the training proeess. That is, formative 
evaluation helps to ensure that (1) the training program is well organized and runs smoothly and (2) trainees 

learn and are satisfied with the program Summative evaluation refers to evaluation eondueted to determine 

the extent to whieh trainees have ehanged as a result of partieipating in the training program. That is, have 
trainees aequired knowledge, skills, attitude, behavior, or other outeomes identified in the training objeetives? 

These two approaehes should be eonsidered as the evaluating tools for the eost-effieieney of WBT. 

There are three benefits in the analysis of eost-effieieney for WBT (Parsons, 1995). Firstly, it ean be possible 
for trainers to see the program in the view of eustomer’s perspeetives when trainers deliver the program. Seeondly, a 
elear index ean make a direetion to diseuss the program with key stakeholders. Lastly, it is helpful to make a 
deeision in the stage of developing the program. 

The Cost-effieieney tools examined in the previous studies provide an integrated tool for the eost-benefit 
analysis of WBT (Cukier, 1997). The following three methods are used to analyze eost-effieieney (Wending & Park, 
2002); eost-to-benefit ratio (CBR) (Wentling & Park, 2002), retum-on- investment (ROI) (Phillips, 1994), and 
breakeven point analysis (Whalen & Wright, 1999). The eost-to-benefit ratio is the present benefits of the program 
divided by initial program eosts: CBR = Program benefits/ program eosts. The return on investment is the ratio of 
the net program benefits over program eosts. The net program benefits are the program benefits minus the eost: ROI 
(%) = Net program benefits/ program eosts X 100. The breakeven analysis is a tool to determine when the program 
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will be able to cover all of its costs and begin to make a benefit. In other word, it indicates that the number of 
students offsets the fixed cost of WBT. 

Decision makers and practitioners in the department of training would like to know how much the training has 
an effect on the company in terms of value or money. They might have some questions: “Does the training have any 
value?”, “How much is training worth with respect to money?”, and “What is the effect of training in the aspect of 
investments?” To answer these questions, both the cost-benefit analysis and the total costs of the training should be 
analyzed. As the first stage of the process, it is necessary to explore what the components of costs should be 
included in WBT. In other words, it is important for the cost-benefit analysis of WBT to determine the missing 
components in its total costs. 

One of the issues in the field of WBT is investigating the missing components to calculate the total costs of 
WBT. Although there are some studies on this topic (Willis, 2003; Bartolic-Zlomislic & Bates, 2002), they are 
insufficient to use generally for the cost analysis of WBT, since they do not take into account hidden factors of the 
components in online courses. In some cases of WBT, the development costs of a course can be a hidden factor 
because the course was developed by using existing resources such as a staff member, using work time or partly 
his/her own time (Curtain, 2002). Also, the opportunity costs of trainees, one of indirect costs is not considered as 
the part of total costs in WBT. 

There are three approaches to explore all of the components associated with costs of WBT. Firstly, the research 
categorizes the costs of WBT, and then finds the components included in the categories. Willis (2003) categorizes 
the costs of WBT such as academic support services, technology and production services, program administrations, 
marketing support, and overall program research and development. In his study, each category has some 
components. Secondly, each component of costs in WBT would be investigated on the basis of the previous training 
models. For instance, the components of costs in WBT would be uncovered in the ADDIE model that stands for 
Analysis, Design, Development, Implementation, and Evaluation (Kruse, 2004). Lastly, the dimensions for the costs 
can be explored by direct costs and indirect dimension, start up cost and ongoing cost, and fixed cost and unfixed 
cost. Accordingly, the components of costs would be located in the dimensions explored. 

If all of components related to the total costs of WBT are revealed, one of the research issues can be assessing 
all the components of costs in WBT. It is difficult to assess such the components as equipment (e.g. computers) and 
the opportunity of trainees. It is often difficult to assess the relative costs of flexible training compared with 
traditional face-to-face teaching, since the costs based on activities are not recorded in many cases (Australian 
National Training Authority Unit Costs Working Group, 1997). 

In general, a company asks vendors to assess the total costs of WBT, in case a company purchases its online 
courses from vendors. The Kia Motor Company also requested vendors to calculate costs of web-based management 
and skill and language training courses. It turned out that the company was hardly able to estimate costs/benefits of 
its programs and assess the effects of the programs due to the lack of accurate data. These problems occur when both 
a company and vendors do not have systematic and scientific methods in assessing costs and benefits of the 
programs. Thus, Jacobs (2005) suggests that it needs strategic training evaluation in the process of calculating the 
cost analysis of the training in order to assess more effectively costs and benefits of the programs. 

Many components of costs in WBT are difficult to assess in terms of money. One of the difficult parts shows 
how the time invested for WBT can be assessed with money. For example, an instructional designer’s time to 
develop online courses must be assessed by money. To calculate it, the criteria should be set based on his/her salary 
or income. The other difficult part is how to assess the opportunity costs of trainees. At this point, the criteria should 
be established to assess it. In addition, the equipment such as a computer must be assessed, if it needs for the 
delivery of a program. 

The goal of a company is to maximize profits, and this goal is directly related to the survival of a company. 
WBT should be in line with this view. A company must, by nature, maximize the profits given level of costs or 
minimize the costs given level of profits. In this sense, finding the optimal level of investment in WBT means a 
profit maximization problem or cost minimization problem. These two problems are often called “the Duality 
problems” in Economics (Haugh, 2003). 

One should keep in mind that costs and benefits of WBT are intertwined and estimated based on both aspects of 
the training program to find the optimal level of investment, that is, costs (Phillips, 1994; Whalen & Wright, 1999; 
Wentling & Park, 2002). Shepherd (2005) suggests that three factors including reducing costs, improving 
effectiveness, and increasing volumes are intertwined to improve cost effectiveness in the workplace. In this 
perspective, the optimal standard cost should lead cheaper learning, better learning, and more learning as much as 
possible. 

Needless to say, the purpose of WBT is that the company computes financial benefits derived from having 
spent money on developing the training programs. Therefore, an organization should build its goals from the 



65-2 




1367 



beginning of the training program to produce organizational desired outcomes. The following four elements are 
critical dimensions to establish goals: personnel, academic programs, facilities, and operational procedures (Chan & 
Richardson, 2002). Accordingly, the optimal standard cost should be established by those four elements in the 
process of developing the cost analysis of WBT. 

Conclusions 

Most decision makers have difficulty in assessing the cost analysis of WBT due to various context of WBT, 
availability of resources, time limitations, and limited budget and so on. Thus, they frequently make their own 
decisions to estimate training costs that can not capture accurate training expenditures for the financial benefits of 
training. 

The ultimate goal of cost analysis of WBT provides decision makers or practitioners with accurate data so that 
they can confidently answer the raised questions: “Does the training have any value?” “How much is training worth 
with respect to money?” “What is the effect of training in the aspect of investments?” Decision makers will use this 
study as a guideline of how to calculate accurate costs of WBT. 

With this study, they will be able to have deeper insights about identifying critical components of cost analysis, 
calculating difficult components of cost analysis, and, more precisely, assessing standard costs of WBT in order to 
reduce the cost of future research. Ultimately, it enables organizations to establish a sound business strategy 
associated with cost reduction and performance improvement for the investment of WBT. 

In addition, further research will be triggered since this study suggests a timely topic in an organization. 

This study also has some limitations as follows. Firstly, the study does not introduce a multitude of case studies 
related to the cost analysis of WBT. That is why the rationale of this study might be weak to discuss the missing 
components of costs in WBT. Secondly, this study does not provide how to possibly conduct research for the 
analysis of costs in WBT in detail. 

Recommendation for future research includes the following: 

1 . To explore components of costs in WBT considering hidden factors 

2. To assess difficult components with the appropriate model such as mathematical formula or qualitative 
criteria 

3. To set the optimal standard cost for a training considering the effectiveness and efficiency of the training 
program. 
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